Conversation log 2021-01-28
Returned to machine learning to determine the naturalness of questions.
If you don't solve the problem of the baseline being off by the question, it's not good enough.
nisbot.iconWhat would you like to see happen in this conversation?
nisbot.iconWhat type of judgment is that judgment?
nishio.iconBinary classification as natural or not natural for the immediately preceding document/question pair, ignoring context
nisbot.iconWhat type of context is that context?
nishio.iconI haven't looked at the relationship between the multiple series of questions or anything like that. So it's possible that the overall flow could be unnatural with this in there, and that's hard to test at hand, so I'm just trying to use it in practice.
nisbot.iconWhat type of question is that?
nishio.iconπ
nisbot.icon
I haven't looked at the relationship between the multiple series of questions or anything like that. So it's possible that the overall flow could be unnatural with this in there, and that's hard to test at hand, so I'm just trying to use it in practice.
Is there anything else you can tell us about this question?
nishio.iconLike, if you don't ask this first, it's not natural to ask this out of the blue.
nisbot.icon
I haven't looked at the relationship between the multiple series of questions or anything like that. So it's possible that the overall flow could be unnatural with this in there, and that's hard to test at hand, so I'm just trying to use it in practice.
Where is this question?
nishio.iconπ
nisbot.icon
I haven't looked at the relationship between the multiple series of questions or anything like that. So it's possible that the overall flow could be unnatural with this in there, and that's hard to test at hand, so I'm just trying to use it in practice.
What does this question seem to be?
nishio.iconπ
nisbot.icon
I haven't looked at the relationship between the multiple series of questions or anything like that. So it's possible that the overall flow could be unnatural with this in there, and that's hard to test at hand, so I'm just trying to use it in practice.
Where is this question?
nishio.iconπ
nisbot.icon
I haven't looked at the relationship between the multiple series of questions or anything like that. So it's possible that the overall flow could be unnatural with this in there, and that's hard to test at hand, so I'm just trying to use it in practice.
What type of linkage is this linkage?
nishio.iconFor example, "Is there anything else?" would be funny if it came out of nowhere.
nisbot.icon
I've turned back on machine learning to determine the naturalness of questions, which I had temporarily turned off, and I'd like to test that.
Is there anything else about this decision?
nishio.iconNothing in particular.
nisbot.icon
Binary classification as natural or not natural for the immediately preceding document/question pair, ignoring context
Is there anything else about this context?
nishio.iconThis time there were many test cases for the flow behavior, so I was able to notice once the flow was broken, and I was able to fix it and confirm that it was back to normal.
nisbot.iconWhat type of behavior is this behavior?
nishio.iconNow "Is there anything else?" is asked first.
nisbot.iconWhat type of destination is the destination?
nishio.iconWhat kind of X is that X?" before asking.
nisbot.iconIs there anything else you can tell us about beyond that?
nishio.iconIf you just cut out the question and ask if it's natural, the question is, "What kind of X?" is more unnatural than "What other kind of X?" is more unnatural than "Is there anything else?
nisbot.iconWhat is the type of type?
nishio.iconNGKW Type
nisbot.iconHow do you know that question?
nishio.iconπ
nisbot.icon
If you just cut out the question and ask if it's natural, the question is, "What kind of X?" is more unnatural than "What other kind of X?" is more unnatural than "What else?
What kind of X ka is this X ka?
nishio.iconNGKW X.
nisbot.icon
"What kind of X is that X?" before asking.
Where is this destination?
nishio.iconNGKW destination
nisbot.icon
"What kind of X is that X?" before asking.
What kind of X is this X?
nishio.iconNGKW X
nisbot.icon
Binary classification as natural or not natural for the immediately preceding document/question pair, ignoring context
Where is this context?
nishio.iconFlow of questions repeated
nisbot.icon
Since there were many test cases for flow behavior this time, I was able to notice once the flow was broken and was able to fix it and confirm that it was back to normal.
Is there anything else you can tell us about this behavior?
nishio.iconIn the end, I decided not to make a naturalness judgment on the two basic questions because I could not reconcile the comfortable order of the two questions with the fact that their naturalness as individual questions did not match the order of the two questions.
nisbot.iconHow will you know the decision?
nishio.iconThe user doesn't know how it's determined internally.
nisbot.iconWhat type of user is this user?
nishio.iconUsers of this chat
nisbot.iconIs there anything else you can tell us about that user?
nishio.iconI want to be asked a good question.
nisbot.iconWhat is it that you value?
nishio.iconIt would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to users, which impairs their comfort.
nisbot.iconWhere is that user located?
nishio.iconπ
nisbot.icon
It would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to the user, which impairs the user's comfort.
What is the relationship between this question and the user?
nishio.iconInformation is drawn from the user by being asked questions.
nisbot.iconIs the user the same as the question? Is it different?
nishio.iconNo, it is not.
nisbot.icon
It would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to the user, which impairs the user's comfort.
What happens to the user when this question is asked?
nishio.iconA good question leads the user to a flow state by providing a series of moderately sized tasks. Asking bad questions confuses the user and interrupts the flow.
nisbot.iconWhat happens to the question when that user
nishio.iconπ
nisbot.icon
It would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to the user, which impairs the user's comfort.
What is the connection between this question and the user?
nishio.iconπ
nisbot.icon
In the end, I decided not to make a naturalness judgment on the two basic questions because I could not reconcile the comfortable order regarding the two basic questions with the fact that their naturalness as individual questions did not match that order.
What is the relationship between this decision and the question?
nishio.iconIf the judgment is well done, the quality of the questions will improve. If it's not done well, it's worse.
nisbot.iconIs that judgment the same as the question? Is it different?
nishio.iconNo, it is not.
nisbot.icon
If the judgment is well done, the quality of questions will improve. If it's not done well, it will get worse.
What happens to the question when this judgment is made?
nishio.iconIf the baseline for judging is off, you're going to lose the diversity of questions by selecting only those questions that tend to be natural as a base.
nisbot.iconWhat happens to the judgment when you ask that question?
nishio.iconπ
nisbot.icon
If the baseline for judging is off, you're going to lose the diversity of questions by selecting only questions that tend to be natural as a base.
What is the relationship between this decision and the user?
nishio.icon(At any rate, I was concerned that it would slow down the response time, but that's not really harmful. The issue of the baseline being off depending on the question needs to be resolved, imho) π.
---
This page is auto-translated from /nishio/δΌθ©±γγ°2021-01-28. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.